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There is no well-known vaccine for coronavirus disease (COVID-19) with 
100% efficiency. COVID-19 patients suffer from a lung infection, where 
lung-related problems can be effectively diagnosed with image techniques. 
The golden test for COVID-19 diagnosis is the RT-PCR test, which is 
costly, time-consuming and unavailable for various countries. Thus, machine 


learning-based tools are a viable solution. Here, we used a labelled chest 


X-ray of three categories, then performed data cleaning and augmentation to 
Keywords: use the data in deep learning-based convolutional neural network (CNN) 
models. We compared the performance of different models that we gradually 


Convolutional neural built and analyzed their accuracy. For that, we used 2905 chest X-ray scan 


COVID-19 samples. We were able to develop a model with the best accuracy of 97.44% 

Deep learning for identifying COVID-19 using X-ray images. Thus, in this paper, we 

Diagnosis attested the feasibility of efficiently applying machine learning (ML) based 

Machine learning models for medical image classification. 
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1. INTRODUCTION 

Currently, the entire world is suffering due to the coronavirus disease (COVID-19). Most of the 
countries all over the world started vaccinating their people for COVID-19 [1]. Thus, vaccines generate 
protection against the illness, as a consequence of developing an immune response to the SARS-Coy-2 virus. 
However, COVID-19 is still threatening global health care, since none of the widely used vaccines has 
approved 100% efficiency without any side effect [2]. Moreover, the ability of the countries to obtain the 
vaccine is as low as their ability to afford reverse transcription-polymerase chain reaction (RT-PCR) tests for 
their residents [3]. As of 26 Dec 2021, the total number of cases confirmed to be infected has surpassed 
238 million, in more than 220 countries, with more than 4.82 million deaths from COVID-19. Thus, it has 
caused calamitous consequences on everyday activities, health care, and global economics. Figure 1(a) shows 
the average number of worldwide new cases per week while Figure 1(b) shows the average number of 
worldwide deaths per week. As shown in Figure 2 the number of people, as 25 Sept 2021, who have received 
at least one dose of a vaccine is 44.8% of the world population, while the number of people who fully 
vaccinated is around 32.9% of the world population. However, more than 20 countries did not reach 1% yet 
while 40 countries have less than 5% of the population being vaccinated. Such numbers show that reaching to 
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100% vaccinated world is a long-journey, specially for low-income countries, where the best solution is 
COVID-19 avoidance and early detection [4]. 
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Figure 1. Average number of world wide (a) new cases per week and (b) deaths per week 


Since the beginning of the pandemic, different repositories, e.g., Github and Kaggle, presented 
online chest X-ray images for natural and infected peoples where such images include notable knowledge 
regarding the COVID-19 virus [5]. The diagnosing process of COVID-19 required the direct contact of the 
infected patients with the medical staff, which is very risky task [6]. Thus, more precautions are required. 
Moreover, the treatment procedure should be strict to reduce the risk of infecting the healthy ones [7]. This 
plague is developing in a sequential process that conveys from one person to another after contacting 
COVID-19 infected bodies [8]. The diagnosis process of this epidemic includes various personnel, e.g., 
doctors, nurses, lab technicians and hospital staff [9]. Therefore, to degrade the effect of COVID-19 several 
approaches have been applied [10]. Moreover, medical imaging is an effective methodology for examining 
and forecasting the influence of COVID-19 on an individual’s well-being [11]. 
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Figure 2. The number of people worldwide who have received a minimum of one dose of a vaccine 


Medical systems, including the healthcare givers, are facing tremendous demands on the available 
resources, e.g., medical tools, RT-PCR test kits, and hospital beds [12]. Thus, the ability to offer a prioritized 
hospitalization for severe cases is crucial, where the inability to do so exacerbates the plague rate and 
significantly hinders disease containment [13]. To help the medical systems, especially in the developed 
countries with limited resources, various prediction models have been introduced for fast, cheap, and reliable 
diagnosis of COVID-19 [14]. 

The main symptoms for COVID-19 include respiratory dysfunction with moderate to critical 
conditions, e.g., sore throat, coughing, and diarrhea, where the virus circulates by air and physical contact 
[15]. Moreover, elderly people with chronic diseases need special handling since they are vulnerable and 
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could exhibit serious breakdown if affected with this disease. Thus, the most familiar response to this 
outbreak is patient isolation and infection-control standards. Whenever the RT-PCR test kits are unavailable 
due to time and/or cost constraints, machine learning-based approaches could be used, where the smart 
analysis of X-ray and computerized tomography (CT) images can easily identify COVID-19 cases [16]. 
However, there is no golden ML-based model where a highly accurate approximation is acceptable in such 
cases [17], [18]. 

Various ML-based techniques are used for disease detection using medical images and signals, e.g., 
electroencephalogram (EEG) [19], electrocardiogram (ECG), and electromyography (EMG) [20]. For 
example, the authors of [21] introduced a ML-based decision assistance scheme for the prediction of 
diabetes, while the authors of [22] used various ML-based techniques for cancer detection. The performance 
of such ML-based approaches is extremely influenced by the quality of the non-optimal and time-consuming 
hand-engineered features [23]. Therefore, implementing an automatic extraction of optimal features, from the 
input data, for efficient feature extraction with enhanced classification precision, is required. Thus, various 
techniques based on deep learning (DL) could be utilized [24], [25]. 

The authors of [26] suggested using deep CNNs for segmenting lung X-ray images. Thus, they were 
able to enhance the performance of clinical diagnosis of different diseases of the lungs. In [27], the authors 
applied CNNs for automatic feature learning and classification. Then, revealed a reliable system to recognize 
breast cancer using histology images [28]. However, using DL models requires large datasets for training, 
where such a huge dataset is not always available. Moreover, the majority of medical images datasets are 
imbalanced with inadequate representation, in addition to privacy and confidentiality concerns of medical 
data [29]. Therefore, different data augmentation methods are introduced to defeat the shortage of labelled 
data and model over-fitting. For that, data alteration, e.g., scaling, flipping, rotation, and transformation, is 
used [30]. 

According to [31], there exist three main mechanisms to utilize CCNs for the classification of 
medical images; preparing the CCN from whatever is available (the scratch); using already pre-trained (off- 
the-shelf) CCNs; unsupervised CCN pre-training with supervised fine-tuning. In this work, we used the first 
mechanism (trained the CCN from the scratch). In this paper, we introduce an efficient DL-based model that 
predicts a positive SARS-CoV-2 infection based on X-ray images. We utilized a well-known machine 
learning method, CNN, which is effective to realize. The proposed model is also able to recognize 
pneumonia as well as normal cases. We trained the model on publicly available data, i.e, Kaggle repository, 
which is used by various related works. Thus, our model can be realized globally for efficient monitoring and 
prioritization of testing for the virus in the worldwide community. 

Next, we describe some of the work that is closely related to this paper based on utilizing X-ray and 
CT images for disease diagnosis. The authors of [32] suggested a Multi-level thresholding and SVM based 
methodology for COVID-19 detection utilizing 40 images of chest X-ray where the obtained accuracy was 
97.48%. Similarly, the authors of [33] introduced a novel framework of DL to diagnose COVID-19, called 
COVIDX-Net. Based on 50 images of chest X-ray, it supports the practitioners to automatically detect 
COVID-19. Based on 25 COVID-19 positives and 25 normal images, the accomplished accuracy was 90%. 

The scholars of [34] introduced various approaches for COVID-19 discovery with the challenges 
facing the RT-PCR. Thus, it is highly obliged to realize an automatic identification method to restrict the 
expanse of the virus through direct communication. While there are various DL approaches for COVID-19 
detection, they are able to detect subjects suffering from pneumonia without the ability to accurately specify 
the exact cause of pneumonia, i.e., whether it is COVID-19, bacterial, or fungal attack. The authors of [35] 
proposed using AI tools, by radiologists and healthcare professionals, for fast and reliable COVID-19 
diagnosis. Due to a shortage of publicly available datasets, the authors built a dataset of 170 X-ray images 
from multiple sources. Then, build a forecasting technique based on DL and transfer learning algorithms. 
Experimental results reveal a 94.1% accuracy based on modified CNN. 

In [36], the authors designed a DL-based model, i1.e., COVID-Net, which delivered a 92.4% success 
rate using 13975 radiography images. The used images are collected from various open access data. A large 
dataset of 1427 X-ray images was collected in [37], where the outcomes indicate that DL with X-ray imaging 
can obtain meaningful biomarkers related to the COVID-19 disease with an accuracy of 96.46%. In their 
study, the authors of [38] investigated the realization of various classification models for COVID-19 
detection where they practiced eleven different CNN models. The best classification model realized accuracy 
of 95.33% for the identification of COVID-19, where that model was based on a deep feature plus SVM. The 
study of [39] proposed five pre-trained CNN-based models for COVID-19 detection using chest X-ray 
images. The models InceptionV3 and ResNet50 achieved an average accuracy of 95.4% and 96.1%, 
respectively. 

The authors of [40] trained a DL-based model on the ResNet-101 CNN architecture using a dataset 
of 4376 X-ray images. They achieved an accuracy of 71.9%, where such low accuracy is due to the shortage 
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of the used images in the testing stage. Various work proposed using CT images for COVID-19 diagnosis, 
e.g., [41]-[44], which achieved an accuracy of 86%, 82.9%, 90.8%, and 86.7%, respectively. It is known that 
a chest X-ray is a reliable first-look exam with low cost, while a CT scan is suitable for exact analysis and 
therapy with high cost. Moreover, CT radiation causes attention for subjects who need dynamic monitoring, 
in addition to investigating children and young patients [45]. Therefore, in this work, we focus on using X- 
ray images while keeping CT images as future work. 


2. CNN-BASED PROPOSED MODEL 
2.1. Convolutional neural networks (CNNs) 

Artificial intelligence (AI) can contribute to the fight against COVID-19 in various ways such as 
immediate alarms and warnings, examination and prediction, following and forecast, treatments, and cures, 
data dashboards, and social control. Machine learning (ML) uses algorithms to analyze big-data and learn 
from it [46]. Then, it will be able to make a prediction or a decision about new unseen data [47]. A well- 
known technique to realize machine learning is deep learning (DL), which employs algorithms caused by the 
composition and functionality of the neurons of the human brain. Artificial neural networks (ANN) are DL 
models that are based on the structure of the brain’s neural network, which is a lightweight design for data 
classification problems. For a given set of inputs, the activation function of a neuron specifies its result. The 
activation function is inspired by the activity of our brain, where several neurons fire, i.e., are operated, by 
several stimuli. ANNs are an expensive solution for image classification problems since 2D images are 
converted to 1D vectors. Thus, 1D vectors will have a large number of trainable parameters with unusual 
storage and processing requirement. On the other hand, CNN, i.e., ConvNets, are a specific type of ANN that 
use convolution operation instead of the common multiplication in one of their layers at least. Thus, in this 
work, we implement CNN in Python. 

The fundamental construction block for CNN are filters, i.e., kernels, which are applied to deduce 
the related features from the input images utilizing the convolution process. CNNs include two main steps, 
where the first step is feature learning, which includes: i) convolution for features learning, ii) application of 
activation function to obtain non-linearity, and iii) pooling to decrease dimensionality and maintain spatial 
invariance. The second step is the classification, where the output of the feature extraction is fed into fully 
connected layers. Then, the output is expressed as the chance of an image pertaining to an appropriate class. 
Generally, the CNNs have various advantages clouding their ability to automatically learn the filters which 
are used for feature extraction from the inputs. Moreover, CNNs capture the spatial features from images, 
i.e., the organization of pixels and the correlation between them. Besides, an individual filter is employed 
across various parts on input images to compose a feature map, i.e., parameter sharing. Section 3.4 explains 
the architecture of the proposed CNN model, including feature extraction and classification. Moreover, 
Table 1 explains the parameters of the layers of the proposed/constructed model. 

A well-known problem in ML-based models is overfitting and underfitting. Model overfitting is 
when the model has high prediction accuracy for the training data while it has low prediction accuracy for the 
testing data. Furthermore, underfitting is when the model is unable to properly predict the class of the data 
even for the data it was trained on. To solve model underfitting we could increase the complexity of the 
model or add more features to the input sample. Data augmentation is achieved by making a conscious 
modification to the training data, e.g., flip, rotate, crop, zoom, and vary the color, in order to produce new 
data and reduce model overfitting. Thus, we ensured that our model is free from over- & under-fitting. 
Figure 3 shows the main phases of our CNN-based proposed design. It includes six main steps, which are 
data preprocessing, importing the necessary modules, data partitioning, building the model by iteratively 
adding layers, fitting the model, and building a Flask webpage as a graphical user interface (GUI). 


none 


Figure 3. The main phases of the CNN-based proposed design 


2.2. Data Set of X-ray images 
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In this work, we handled chest X-ray images of three classes, i.e., normal, viral pneumonia, and 
COVID-19 infected where Figure 4 depicts a sample set of the used images. For the collected dataset which 
covers three classes, we collect 1345 X-ray images of the normal class, 1342 X-ray images of the pneumonia 
class, and 217 images of the COVID-19 class. Thus, the complete number of images of the dataset is 2905. 
This data has been obtained from the Kaggle repository [48] and used by previous works, e.g., [32]-[40]. In 
the exploratory analysis we divide the data into a training set of 2324 images, i.e., 80% of the data, and a 
validation set of 581 images, i.e., 20% of the data such data partitioning is used by most of ML models and 
various related works. For parameter tuning, we used 464 images while performed final model testing by the 
remaining 117 images. 

Regarding data preprocessing, we exported the X-ray images, with their APIs, from the Kaggle 
repository [48]. Then, we cleaned the exported data. It is well-known that DL methods require a large dataset 
of images to obtain a reliable result, which is not always available due to privacy issues, cost, and data 
generation time. Thus, we augmented the data through performing data transformation, e.g., rotating and 
scaling, to extend the size of the training data. Moreover, data enlargement solves the problem of model over- 
fitting and improves the achieved accuracy. 


Viral 
Pneumonia 


covibD19 


Figure 4. A sample of data set of X-ray images 


2.3. Import the required modules 

We used Keras, which is a deep learning Python library. It offers simple and compatible application 
programming interface (API) with easily explained error messages. Thus, the required user actions are 
minimal. If needed, comprehensive documentation and guidance are also available. Keras enables a fast 
transition from the idea to the result. We used Adam as an optimization algorithm and Relu as an activation 
function. Moreover, we used various libraries as explained next. 

With images, efficient computing requires performing operations on data as vectors and matrices. 
Thus, linear algebra is required where the scientific computing library, i.e., NumPy, is utilized. 
Communicating with the operating system is achieved by various functions implemented by the OS module 
in Python. For data science and analytics, we use the Pandas module which runs on top of the NumPy library. 
The sequential module allows creating a deep learning model by adding layers to it. However, some 
architectures are not linear stacks, e.g., a Siamese NN, which concurrently works on two different input 
vectors. However, in this work, we use the sequential model. Flatten library converts multi-dimension 
matrices to vectors. 


2.4. Developing deep learning-based model 

For the implementation of the target design, we considered various features, i.e., design 
specifications, that are related to the neural network and the associated web page. The main three features 
are: 1) time complexity where an efficient algorithm will have a short execution time, ii) performance where a 
high prediction accuracy is obtained by changing the number of layers of the NN, the number of the nodes 
per layer, and the type of the activation function, and iii) novelty where a new design is implemented without 
using previous designs. 

We obtained the data from the Kaggle repository, cleaned it, and performed data augmentation. 
Then, this data is applied to train the suggested model. For more useful investigation, we implemented 
various models with different settings. Then, we examine their performance to determine the accuracy. We 
plan to reduce the loss function with succeeding epochs, where one Epoch is when a complete dataset is 
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moved forward and backward within the neural network once. Therefore, we adopted Adam optimizer with a 
learning rate (LR)=0.001 for model training. We have employed the categorical cross-entropy loss to train 
our model. In the proposed models, we used the default activation function, i.e., the rectified linear unit 
(ReLU), which is shown in Figure 5 where y=Max(0,x). Figure 6 shows the structure of the proposed model 
where more implementation details are given in Table 1. 


< 
i] 


y=0 


Figure 5. Activation functions: RELU 


Figure 6. The architecture of the proposed CNN Model 


Table 1. Parameters of the layers of the proposed model. 


Number of Layers Layer (Type) Output Shape _ Number of Trainable Parameters 

1 Conv-2D (222, 222, 32) 896 

2 Max pool-2D (111, 111, 32) 0 

3 Conv-2D (109, 109, 64 18496 
4 Max pool-2D (36, 36, 64) 0 

5 Conv-2D (34, 34, 64) 36928 
6 Max pool-2D (17, 17, 64) 0 

wf Flatten (18496) 0 

8 Dense (512) 9470464 
9 Dropout (512) 0 

10 Dense (256) 131328 
11 Dropout (256) 0 

12 Dense (128) 32896 
13 Dropout (128) 0 
14 Batch Normalization (128) 512 
15 Dense (64) 8256 
16 Dropout (64) 0 
17 Dense (3) 195 


Padding is a technique that allows us to keep the size of the filtered image the same as the original 
image. However, we did not use padding in any convolutional layer (P=0). This is why for an input image of 
size nxn, we obtain an output image of size n-2xn-2. Application of the filter to the input image requires 
moving the filter from left to right and from top to bottom. The amount of this movement is defined as stride. 
The default value of the stride is (1,1) for the horizontal and vertical movement, where such value works well 
for most of the cases. Therefore, we applied the default value of the filters in all convolutional layers in this 
work. When performing a stride convolution for an input image of size nxn, padding is (P), the stride is (S), 
and the filter size is FxF. Then the size of the output is defined as in (1). 


Output size = + 1) +1) (1) 
As shown in Figure 6, we used convolution and maximum pooling thrice, where the used X-ray 
images are of size 224x224 pixels. The size of the filter for the three convolutional layers is 3x3 while S=1. 


An efficient machine learning-based covid-19 identification utilizing chest x-ray ... (Mahmoud Masadeh) 


362 i) ISSN: 2252-8938 


For the first layer, the convolution result is an images of size 222x222. Then, we applied the max pool 
function with S=2 and F=2, utilizing 32 filters. The result of maximum pooling is images of size of 111x111. 
Regarding the second layer, the max pool function has S=3 and F=3, utilizing 64 filters. On the other hand, 
the third layer has S=2 and F=2, which is similar to the first layer. The output shape of the 3 layers is shown 
in Table 1, which are directly obtained according to (1). 

The result of applying 2D convolution and max-pooling has the size of (17, 17, 64). Then, Flatten 
which converts multi-dimension matrices to vector, is applied to convert the data from 17x17x64 to 18496. 
The dense, i.e., fully connected layer, which is a linear operation on the layer’s input vector, is used 5 times 
(layer 8, 10, 12, 15 and 17). The input vector for the first dense layer is 512 which is reduced by 2 to reach 64 
for the 4th dense layer, while the 5th dense layer has an output vector of 3 which represents one class of the 
X-ray possible types. Dropout is a well-known regularization procedure, which aims to decrease the 
complexity of the model with the aim to stop overfitting. Thus, we applied dropout 4 times directly after 
applying dense operation. Batch normalization technique is designed to standardize the inputs to a layer in 
CNN. Thus, it significantly expediting the training process with improved performance. In our model, we 
applied batch normalization once after the third pair of dense-dropout. 


3. RESULTS AND DISCUSSION 

Figure 7 shows the training loss and validation loss for the 30 epochs of model training. We notice 
that the training loss starts with the maximum of 1.83 for the first epoch and reaches 0.073 for the last epoch. 
Regarding the validation loss, it starts by a value of 0.74 and reaches a maximum of 1.46 at epoch 11. Then, 
the loss starts decreasing until it reaches 0.155 at the last epoch. 
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Figure 7. The training and validation loss of the model with successive epochs 


Figure 8 shows the training and validation accuracy for the 30 epochs of model training. Regarding 
the accuracy of the training model, it starts by 32.1% and reaches the maximum of 97.55% at the last epoch. 
The last step was building a flask web page, where flask is a web framework written in Python. It does not 
require specific tools or libraries, does not include an abstraction method for the database, and it is a reliable 
framework for web users. We evaluated the proposed model based on accuracy as given in (2). The obtained 
confusion matrix, for evaluating the accuracy of the model on the testing data, is shown in Figure 9. The 
achievable accuracy is 97.44% for testing while the accuracy for the training was 97.55% as shown in Figure 8. 
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Figure 8. The training and validation accuracy of the model with successive epochs 
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The model is called though an interface using flask page as shown in Figure 10. Accordingly, 
Figures 10(a), 10(b), and 10(c) show the results provided by the model for given images, where these images 
are classified as normal, COVID-19, and viral pneumonia, respectively. In section 2. we explained various 
works which are closely related to this work. Table 2 shows a tabular comparison of the proposed model with 
various related work, i.e., based on chest X-ray and CT images. Moreover, the table shows the number of 
used images, the type of the images, the used method, and the final accuracy of the model. 
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Figure 9. The confusion matrix of the testing data 


Accuracy = True Positive+True Negative 0) 
y= True Positive+True Negative+False Positive+False Negative 
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Figure 10. The GUI of the flask page for COVID-19 detection (a) result: normal, (b) result: COVID-19, and 
(c) result: viral pneumonia 
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Table 2. Comparison between related DL models for covid-19 identification 


Work Number of Cases _ Type of Images Method Accuracy (%) 
[33] 50 X-ray COVIDX-Net 90 
[35] 170 X-ray CNN 94.1 
[36] 13645 X-ray COVID-Net 92.4 
[37] 1427 X-ray VGG-19 96.78 
[38] 50 X-ray ResNet50+SVM 95.33 
[39] 100 X-ray InceptionV3 95.4 
[39] 100 X-ray ResNet50 96.1 
[40] 4376 X-ray ResNet-101 71.9 
[41] 1485 CT DRE-Net 86 
[42] 453 CT M-Inception 82.9 
[43] 542 CT UNet+3D Deep Network 90.8 
[44] 618 CT ResNet + Location Attention 86.7 

Proposed 2905 X-ray CNN 97.44 


Various authors used the dataset [48] for Covid detection, where they utilized standard CNN 
architectures, e.g., ResNet. Because of its compelling results, ResNet quickly became one of the most 
popular architectures in various computer vision tasks. Although ResNet has proven powerful in many 
applications, one major drawback is that a deeper network usually requires weeks for training, making it 
practically infeasible in real-world applications. ResNet-50 is a CNN that is 50 layers deep, while ResNet- 
101 CNN is 101 layers deep. We evaluated the accuracy of our proposed architecture using datasets of 
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previous related works, i.e., [33]-[40]. We obtained a competitive accuracy. The use of mobile phones to 
scan X-ray images for the detection of COVID-19 is considered as an extension of this work. 


4. CONCLUSION 

The latest world pandemic of COVID-19 is progressing daily without a 100% efficient vaccine that 
has no side effect. Therefore, it is important to quickly identify the infected people to decrease the extent of 
the COVID-19 by prevention procedures and providing the required health care for the infected ones. Most 
countries, especially those that have limited resources, are unable to provide the required fast, cheap, and 
accurate tests to detect the infected cases. Therefore, in this paper, based on a limited set of chest X-ray 
scans, we investigated various CNN models to detect COVID-19 cases. Our proposed design is completely 
automated including automatic feature extraction. Moreover, the build models can classify the X-ray into 
infected, normal, or pneumonia, 1.e., three-class classification, with a test accuracy of 97.44% and training 
accuracy of 97.55%. We tested the proposed model/framework on various data sets which are used by 
previous works. The testing accuracy was indistinguishable with the accuracy of testing the model based on 
the training data. Our CNNbased model is usable by radiologists to aid in confirming their initial screening of 
patients where a negligible accuracy loss is accepted. Thus, this approach is applicable for automatic disease 
diagnosis e.g., remote places affected by COVID-19. Moreover, we could use it to diagnose other chest- 
related diseases. To verify the high accuracy obtained, we tested the models based on the newly introduced 
public data and obtained almost the same accuracy. The main limitation of the work is using a limited 
amount of labelled X-ray images for COVID19. Thus, future work will make the model more accurate by 
using more images. Moreover, the use of magnetic resonance imaging (MRI) and computed tomography 
(CT) images could be investigated in addition to X-ray images. Finally, COVID-19 belongs to the same 
family of severe acute respiratory syndrome coronavirus (SARS-CoV) and Middle East Respiratory 
Syndrome-related Coronavirus (MERS-CoV). Thus, it is possible to detect SARS-CoV and MERS-CoV 
utilizing chest x-ray and the proposed model/framework. 
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